Coordination Problem
   HOME

TheInfoList



OR:

A coordination game is a type of simultaneous game found in
game theory Game theory is the study of mathematical models of strategic interactions among rational agents. Myerson, Roger B. (1991). ''Game Theory: Analysis of Conflict,'' Harvard University Press, p.&nbs1 Chapter-preview links, ppvii–xi It has appli ...
. It describes the situation where a player will earn a higher payoff when they select the same course of action as another player. The game is not one of pure conflict, which results in multiple
pure strategy In game theory, a player's strategy is any of the options which they choose in a setting where the outcome depends ''not only'' on their own actions ''but'' on the actions of others. The discipline mainly concerns the action of a player in a game ...
Nash equilibria In game theory, the Nash equilibrium, named after the mathematician John Nash, is the most common way to define the solution of a non-cooperative game involving two or more players. In a Nash equilibrium, each player is assumed to know the equili ...
in which players choose matching strategies. Figure 1 shows a 2-player example. Both (Up, Left) and (Down, Right) are Nash equilibria. If the players expect (Up, Left) to be played, then player 1 thinks their payoff would fall from 2 to 1 if they deviated to Down, and player 2 thinks their payoff would fall from 4 to 3 if they chose Right. If the players expect (Down, Right), player 1 thinks their payoff would fall from 2 to 1 if they deviated to Up, and player 2 thinks their payoff would fall from 4 to 3 if they chose Left. A player's optimal move depends on what they expect the other player to do, and they both do better if they coordinate than if they played an off-equilibrium combination of actions. This setup can be extended to more than two strategies or two players.


Examples

A typical case for a coordination game is choosing the sides of the road upon which to drive, a social standard which can save lives if it is widely adhered to. In a simplified example, assume that two drivers meet on a narrow dirt road. Both have to swerve in order to avoid a head-on collision. If both execute the same swerving maneuver they will manage to pass each other, but if they choose differing maneuvers they will collide. In the
payoff matrix In game theory, normal form is a description of a ''game''. Unlike extensive form, normal-form representations are not graphical ''per se'', but rather represent the game by way of a matrix. While this approach can be of greater use in identifying ...
in Fig. 2, successful passing is represented by a payoff of 8, and a collision by a payoff of 0. In this case there are two pure Nash equilibria: either both swerve to the left, or both swerve to the right. In this example, it doesn't matter ''which'' side both players pick, as long as they both pick the same. Both solutions are
Pareto efficient Pareto efficiency or Pareto optimality is a situation where no action or allocation is available that makes one individual better off without making another worse off. The concept is named after Vilfredo Pareto (1848–1923), Italian civil engin ...
. This game is called a '' pure coordination game''. This is not true for all coordination games, as the '' assurance game'' in Fig. 3 shows. An assurance game describes the situation where neither player can offer a sufficient amount if they contribute alone, thus player 1 should defect from playing if player 2 defects. However, if Player 2 opts to contribute then player 1 should contribute also. An assurance game is commonly referred to as a “
stag hunt In game theory, the stag hunt, sometimes referred to as the assurance game, trust dilemma or common interest game, describes a conflict between safety and social cooperation. The stag hunt problem originated with philosopher Jean-Jacques Roussea ...
” (Fig.5), which represents the following scenario. Two hunters can choose to either hunt a stag together (which provides the most economically efficient outcome) or they can individually hunt a Rabbit. Hunting Stags is challenging and requires cooperation. If the two hunters do not cooperate the chances of success is minimal. Thus, the scenario where both hunters choose to coordinate will provide the most beneficial output for society. A common problem associated with the stag hunt is the amount of trust required to achieve this output. Fig. 5 shows a situation in which both players (hunters) can benefit if they cooperate (hunting a stag). As you can see, cooperation might fail, because each hunter has an alternative which is safer because it does not require cooperation to succeed (hunting a hare). This example of the potential conflict between safety and social cooperation is originally due to
Jean-Jacques Rousseau Jean-Jacques Rousseau (, ; 28 June 1712 – 2 July 1778) was a Genevan philosopher, writer, and composer. His political philosophy influenced the progress of the Age of Enlightenment throughout Europe, as well as aspects of the French Revolu ...
. This is different in another type of coordination game commonly called battle of the sexes (or conflicting interest coordination), as seen in Fig. 4. In this game both players prefer engaging in the same activity over going alone, but their preferences differ over which activity they should engage in. Assume that a couple argues over what to do on the weekend. Both know that they will increase their utility by spending the weekend together, however the man prefers to watch a football game and the woman prefers to go shopping. Since the couple want to spend time together, they will derive no utility by doing an activity separately. If they go shopping, or to football game one person will derive some utility by being with the other person, but won’t derive utility from the activity itself. Unlike the other forms of coordination games described previously, knowing your opponent’s strategy won’t help you decide on your course of action. Due to this there is a possibility that an equilibrium will not be reached.


Voluntary standards

In
social sciences Social science is one of the branches of science, devoted to the study of societies and the relationships among individuals within those societies. The term was formerly used to refer to the field of sociology, the original "science of soci ...
, a voluntary standard (when characterized also as ''de facto'' standard) is a typical solution to a coordination problem. The choice of a voluntary standard tends to be stable in situations in which all parties can realize mutual gains, but only by making mutually consistent decisions.
In contrast, an obligation standard (enforced by law as "''
de jure In law and government, ''de jure'' ( ; , "by law") describes practices that are legally recognized, regardless of whether the practice exists in reality. In contrast, ("in fact") describes situations that exist in reality, even if not legally ...
'' standard") is a solution to the prisoner's problem.


Mixed strategy Nash equilibrium

Coordination games also have
mixed strategy In game theory, a player's strategy is any of the options which they choose in a setting where the outcome depends ''not only'' on their own actions ''but'' on the actions of others. The discipline mainly concerns the action of a player in a game ...
Nash equilibria In game theory, the Nash equilibrium, named after the mathematician John Nash, is the most common way to define the solution of a non-cooperative game involving two or more players. In a Nash equilibrium, each player is assumed to know the equili ...
. In the generic coordination game above, a mixed Nash equilibrium is given by probabilities p = (d-b)/(a+d-b-c) to play Up and 1-p to play Down for player 1, and q = (D-C)/(A+D-B-C) to play Left and 1-q to play Right for player 2. Since d > b and d-b < a+d-b-c, p is always between zero and one, so existence is assured (similarly for q). In the generic coordination game in Fig. 6, a mixed Nash equilibrium is given by the probabilities: p = (d-b)/(a+d-b-c), to play Option A and 1-p to play Option B for player 1, and q = (D-C)/(A+D-B-C), to play A and 1-q to play B for player 2. If we look at Fig 1. and apply the same probability equations we obtain the following results: p = (4-3) / (4+4-3-3) = ½ and, q = (2-1) / (2+2-1-1) = ½ The reaction correspondences for 2×2 coordination games are shown in Fig. 7. The pure Nash equilibria are the points in the bottom left and top right corners of the strategy space, while the mixed Nash equilibrium lies in the middle, at the intersection of the dashed lines. Unlike the pure Nash equilibria, the mixed equilibrium is not an
evolutionarily stable strategy An evolutionarily stable strategy (ESS) is a strategy (or set of strategies) that is ''impermeable'' when adopted by a population in adaptation to a specific environment, that is to say it cannot be displaced by an alternative strategy (or set of ...
(ESS). The mixed Nash equilibrium is also Pareto dominated by the two pure Nash equilibria (since the players will fail to coordinate with non-zero probability), a quandary that led
Robert Aumann Robert John Aumann (Hebrew name: , Yisrael Aumann; born June 8, 1930) is an Israeli-American mathematician, and a member of the United States National Academy of Sciences. He is a professor at the Center for the Study of Rationality in the Hebrew ...
to propose the refinement of a
correlated equilibrium In game theory, a correlated equilibrium is a solution concept that is more general than the well known Nash equilibrium. It was first discussed by mathematician Robert Aumann in 1974. The idea is that each player chooses their action according t ...
.


Coordination and equilibrium selection

Games like the driving example above have illustrated the need for solution to coordination problems. Often we are confronted with circumstances where we must solve coordination problems without the ability to communicate with our partner. Many authors have suggested that particular equilibria are focal for one reason or another. For instance, some equilibria may give higher payoffs, be naturally more salient, may be more fair, or may be
safer In cryptography, SAFER (Secure And Fast Encryption Routine) is the name of a family of block ciphers designed primarily by James Massey (one of the designers of IDEA) on behalf of Cylink Corporation. The early SAFER K and SAFER SK designs share ...
. Sometimes these refinements conflict, which makes certain coordination games especially complicated and interesting (e.g. the
Stag hunt In game theory, the stag hunt, sometimes referred to as the assurance game, trust dilemma or common interest game, describes a conflict between safety and social cooperation. The stag hunt problem originated with philosopher Jean-Jacques Roussea ...
, in which has higher payoffs, but is safer).


Experimental results

Coordination games have been studied in laboratory experiments. One such experiment by Bortolotti, Devetag, and
Andreas Ortmann Andreas Ortmann (born 28 January 1953 in Oerlinghausen, North Rhine-Westphalia, Germany) is a German-born economist and Professor of Experimental and Behavioural Economics at the UNSW Business School.
was a weak-link experiment in which groups of individuals were asked to count and sort coins in an effort to measure the difference between individual and group incentives. Players in this experiment received a payoff based on their individual performance as well as a bonus that was weighted by the number of errors accumulated by their worst performing team member. Players also had the option to purchase more time, the cost of doing so was subtracted from their payoff. While groups initially failed to coordinate, researchers observed about 80% of the groups in the experiment coordinated successfully when the game was repeated. When academics talk about coordination failure, most cases are that subjects achieve
risk dominance Risk dominance and payoff dominance are two related refinements of the Nash equilibrium (NE) solution concept in game theory, defined by John Harsanyi and Reinhard Selten. A Nash equilibrium is considered payoff dominant if it is Pareto superior ...
rather than payoff dominance. Even when payoffs are better when players coordinate on one equilibrium, many times people will choose the less risky option where they are guaranteed some payoff and end up at an equilibrium that has sub-optimal payoff. Players are more likely to fail to coordinate on a riskier option when the difference between taking the risk or the safe option is smaller. The laboratory results suggest that coordination failure is a common phenomenon in the setting of order-statistic games and stag-hunt games.


Other games with externalities

Coordination games are closely linked to the economic concept of
externalities In economics, an externality or external cost is an indirect cost or benefit to an uninvolved third party that arises as an effect of another party's (or parties') activity. Externalities can be considered as unpriced goods involved in either co ...
, and in particular positive network externalities, the benefit reaped from being in the same
network Network, networking and networked may refer to: Science and technology * Network theory, the study of graphs as a representation of relations between discrete objects * Network science, an academic field that studies complex networks Mathematics ...
as other agents. Conversely, game theorists have modeled behavior under negative externalities where choosing the same action creates a cost rather than a benefit. The generic term for this class of game is anti-coordination game. The best-known example of a 2-player anti-coordination game is the game of
Chicken The chicken (''Gallus gallus domesticus'') is a domesticated junglefowl species, with attributes of wild species such as the grey and the Ceylon junglefowl that are originally from Southeastern Asia. Rooster or cock is a term for an adult m ...
(also known as
Hawk-Dove game The game of chicken, also known as the hawk–dove game or snowdrift game, is a model of conflict for two players in game theory. The principle of the game is that while the ideal outcome is for one player to yield (to avoid the worst outcome if ...
). Using the payoff matrix in Figure 1, a game is an anti-coordination game if B > A and C > D for row-player 1 (with
lowercase Letter case is the distinction between the Letter (alphabet), letters that are in larger uppercase or capitals (or more formally ''majuscule'') and smaller lowercase (or more formally ''minuscule'') in the written representation of certain lang ...
analogues b > d and c > a for column-player 2). and are the two pure Nash equilibria. Chicken also requires that A > C, so a change from to improves player 2's payoff but reduces player 1's payoff, introducing conflict. This counters the standard coordination game setup, where all unilateral changes in a strategy lead to either mutual gain or mutual loss. The concept of anti-coordination games has been extended to multi-player situation. A crowding game is defined as a game where each player's payoff is
non-increasing In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is called ...
over the number of other players choosing the same strategy (i.e., a game with negative network externalities). For instance, a driver could take
U.S. Route 101 U.S. Route 101, or U.S. Highway 101 (US 101), is a north–south United States Numbered Highway that runs through the states of California, Oregon, and Washington, on the West Coast of the United States. It is also known as (The Royal Roa ...
or Interstate 280 from
San Francisco San Francisco (; Spanish language, Spanish for "Francis of Assisi, Saint Francis"), officially the City and County of San Francisco, is the commercial, financial, and cultural center of Northern California. The city proper is the List of Ca ...
to San Jose. While 101 is shorter, 280 is considered more scenic, so drivers might have different preferences between the two independent of the traffic flow. But each additional car on either route will slightly increase the drive time on that route, so additional traffic creates negative network externalities, and even scenery-minded drivers might opt to take 101 if 280 becomes too crowded. A congestion game is a crowding game in networks. The
minority game The El Farol bar problem is a problem in game theory. Every Thursday night, a fixed population want to go have fun at the El Farol Bar, unless it's too crowded. * If less than 60% of the population go to the bar, they'll all have more fun than if ...
is a game where the only objective for all players is to be part of smaller of two groups. A well-known example of the minority game is the
El Farol Bar problem The El Farol bar problem is a problem in game theory. Every Thursday night, a fixed population want to go have fun at the El Farol Bar, unless it's too crowded. * If less than 60% of the population go to the bar, they'll all have more fun than if ...
proposed by
W. Brian Arthur William Brian Arthur (born 31 July 1945) is an economist credited with developing the modern approach to increasing returns. He has lived and worked in Northern California for many years. He is an authority on economics in relation to complexi ...
. A hybrid form of coordination and anti-coordination is the discoordination game, where one player's incentive is to coordinate while the other player tries to avoid this. Discoordination games have no pure Nash equilibria. In Figure 1, choosing payoffs so that A > B, C < D, while a < b, c > d, creates a discoordination game. In each of the four possible states either player 1 or player 2 are better off by switching their strategy, so the only Nash equilibrium is mixed. The canonical example of a discoordination game is the
matching pennies Matching pennies is the name for a simple game used in game theory. It is played between two players, Even and Odd. Each player has a penny and must secretly turn the penny to heads or tails. The players then reveal their choices simultaneously ...
game.


See also

*
Collective action Collective action refers to action taken together by a group of people whose goal is to enhance their condition and achieve a common objective. It is a term that has formulations and theories in many areas of the social sciences including psych ...
*
Consensus decision-making Consensus decision-making or consensus process (often abbreviated to ''consensus'') are group decision-making processes in which participants develop and decide on proposals with the aim, or requirement, of acceptance by all. The focus on es ...
*
Cooperative game Cooperative game may refer to: * Cooperative board game, board games in which players work together to achieve a common goal * Cooperative game theory, in game theory, a game with competition between groups of players and the possibility of cooperat ...
*
Coordination failure (economics) In economics, coordination failure is a concept that can explain recessions through the failure of firms and other price setters to coordinate. In an economic system with multiple equilibria, coordination failure occurs when a group of firms coul ...
* Equilibrium selection *
Non-cooperative game In game theory, a non-cooperative game is a game with competition between individual players, as opposed to cooperative games, and in which alliances can only operate if self-enforcing (e.g. through credible threats). However, 'cooperative' and ...
*
Self-fulfilling prophecy A self-fulfilling prophecy is a prediction that comes true at least in part as a result of a person's or group of persons' belief or expectation that said prediction would come true. This suggests that people's beliefs influence their actions. ...
*
Strategic complements In economics and game theory, the decisions of two or more players are called strategic complements if they mutually reinforce one another, and they are called strategic substitutes if they mutually offset one another. These terms were originally ...
*
Social dilemma Social organisms, including human(s), live collectively in interacting populations. This interaction is considered social whether they are aware of it or not, and whether the exchange is voluntary or not. Etymology The word "social" derives from ...
*
Supermodular In mathematics, a function :f\colon \mathbb^k \to \mathbb is supermodular if : f(x \uparrow y) + f(x \downarrow y) \geq f(x) + f(y) for all x, y \isin \mathbb^, where x \uparrow y denotes the componentwise maximum and x \downarrow y the componentw ...
* Uniqueness or multiplicity of equilibrium


References

Other suggested literature: *
Russell Cooper Theo Russell Cooper (born 4 February 1941) is a former Australian National Party of Australia – Queensland, National Party politician. He was Premier of Queensland for a period of 73 days, from 25 September 1989 to 7 December 1989. His loss ...
: ''Coordination Games'', Cambridge: Cambridge University Press, 1998 (). *
Avinash Dixit Avinash Kamalakar Dixit (born 6 August 1944) is an Indian-American economist. He is the John J. F. Sherrerd '52 University Professor of Economics Emeritus at Princeton University, and has been Distinguished Adjunct Professor of Economics at Lin ...
&
Barry Nalebuff Barry J. Nalebuff (born July 11, 1958) is an American businessman, business theorist, and writer. He is a Milton Steinbach Professor of Management at Yale School of Management and author who specializes in business strategy and game theory. His p ...
: '' Thinking Strategically: The Competitive Edge in Business, Politics, and Everyday Life'', New York: Norton, 1991 (). * Robert Gibbons: ''Game Theory for Applied Economists'', Princeton, New Jersey: Princeton University Press, 1992 (). *
David Kellogg Lewis David (; , "beloved one") (traditional spelling), , ''Dāwūd''; grc-koi, Δαυΐδ, Dauíd; la, Davidus, David; gez , ዳዊት, ''Dawit''; xcl, Դաւիթ, ''Dawitʿ''; cu, Давíдъ, ''Davidŭ''; possibly meaning "beloved one". w ...
: ''Convention: A Philosophical Study'', Oxford: Blackwell, 1969 (). * Martin J. Osborne &
Ariel Rubinstein Ariel Rubinstein (Hebrew: אריאל רובינשטיין; born April 13, 1951) is an Israeli economist who works in economic theory, game theory and bounded rationality. Biography Ariel Rubinstein is a professor of economics at the School of ...
: ''A Course in Game Theory'', Cambridge, Massachusetts: MIT Press, 1994 (). *
Thomas Schelling Thomas Crombie Schelling (April 14, 1921 – December 13, 2016) was an American economist and professor of foreign policy, national security, nuclear strategy, and arms control at the School of Public Policy at University of Maryland, College ...
: ''The Strategy of Conflict'', Cambridge, Massachusetts: Harvard University Press, 1960 (). *
Thomas Schelling Thomas Crombie Schelling (April 14, 1921 – December 13, 2016) was an American economist and professor of foreign policy, national security, nuclear strategy, and arms control at the School of Public Policy at University of Maryland, College ...
: ''Micromotives and Macrobehavior'', New York: Norton, 1978 (). * Adrian Piper
review of 'The Emergence of Norms'
in The Philosophical Review, vol. 97, 1988, pp. 99–107. * Bortolotti, Stefania; Devetag, Giovanna; Ortmann, Andreas (2016-01-01)

''Journal of Economic Psychology''. 56 (C): 60–73.
ISSN An International Standard Serial Number (ISSN) is an eight-digit serial number used to uniquely identify a serial publication, such as a magazine. The ISSN is especially helpful in distinguishing between serials with the same title. ISSNs ...
br>0167-4870
* Devetag, Giovanna; Ortmann, Andreas (2006-08-15). "When and Why? A Critical Survey on Coordination Failure in the Laboratory". Rochester, NY: Social Science Research Network. {{Game theory Non-cooperative games